Method for intelligent consumer earcons

ABSTRACT

A method for utilizing earcons, includes: forming a database of earcons; forming a user profile and preferences database; monitoring user audio content; monitoring the user environment; playing a series of earcons from the database of earcons on a user&#39;s communication device; wherein the series of earcons are chosen from the database of earcons based on the user profile and preferences database; and wherein the playing of individual earcons from the series of earcons is based on the monitored user audio content and environment.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is co-pending with the concurrently filedapplication, entitled “SYSTEM FOR INTELLIGENT CONSUMER EARCONS,”assigned to the assignee of the present application, the contents ofwhich are incorporated herein by reference in their entirety.

TRADEMARKS

IBM® is a registered trademark of International Business MachinesCorporation, Armonk, N.Y., U.S.A. Other names used herein may beregistered trademarks, trademarks or product names of InternationalBusiness Machines Corporation or other companies.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to earcons, and more particularly to amethod for providing intelligent consumer earcons to mobile and fixedlandline communication subscribers.

2. Description of the Related Art

Earcons are auditory icons. Earcons are sounds or tones used torepresent a specific event, item, or object. An earcon can beparameterized by specific attributes of the item or event. Earcons alsoemploy sound cues about the content and organization of information.Earcons are generally not auditory caricatures of the signified item orevent, that is, they are abstract rhythmic/melodic patterns rather thaneveryday sounds.

The utilization of earcons or non-speech audio with varioususer-interfaces is becoming increasingly popular due to the potentialbenefits earcons offer. An earcon is a useful complement to visualoutput, because earcons can increase the amount of informationcommunicated to the user, or reduce the amount of information the userhas to receive through the visual channel. Earcons make use of theauditory senses, which is powerful but under-utilized sense in mostcurrent interfaces.

Earcons are commonly utilized in automobiles, consumer electronics,computers, and communication applications. For example, the sounds adriver hears when leaving the car lights on or the key in the ignitionare earcons. Further examples of earcon usage are user audio prompts,such as when a person is prompted to leave a message after the “beep”,interactive and automated phone services, or to withdraw their cash atan automated transaction machine with auditory cues.

SUMMARY OF THE INVENTION

Embodiments of the present invention include a method for utilizingearcons, the method includes: forming a database of earcons; forming auser profile and preferences database; monitoring user audio content;monitoring the user environment; playing a series of earcons from thedatabase of earcons on a user's communication device; wherein the seriesof earcons are chosen from the database of earcons based on the userprofile and preferences database; and wherein the playing of individualearcons from the series of earcons is based on the monitored user audiocontent and environment.

In one aspect of the invention, the database of earcons is comprised ofat least one of the following: company, product, service, retaillocation, and earcon length information, the user profile andpreferences database is comprised of user and observationally supplieduser profile information, and the user profile and preferences databaseis comprised of user biometric data, wherein the user biometric datacomprises gender of the user; age of the user; accent of the user;native language of the user; dialect of the user; socioeconomicclassification of the user; educational level of the user; and emotionalstate of the user. In addition, the user profile and preferencesdatabase is comprised of user preferences, wherein the user preferencescomprise the types of companies, products, services the user wants toreceive earcons about; and wherein the user preferences further comprisespecified audio levels, lengths, and points in the usage of thecommunication device and the conversation for playing the earcons.

In another aspect of the invention, the monitoring of user audio contentcomprises using a speech recognition system to detect and interpretconversational content; wherein based on the interpreted conversationalcontent earcons are chosen for playback on the user's communicationsdevice. In addition, the monitoring of user audio content is used todetermine pauses in the user's conversation, and wherein based on thedetermined pauses and their respective length, earcons are chosen forplayback on the user's communications device.

In another aspect of the invention, the monitoring of the userenvironment comprises tracking the location of the user, wherein thetracking of user location comprises the use of at least one of thefollowing: global positioning system (GPS) satellites and relatedelectronic device chip sets within the communication devices, cellularphone infrastructure, and Internet gateways. Wherein based on the userlocation an earcon is chosen for playback on the user's communicationsdevice.

In another aspect of the invention, the communication devices comprisecellular phones, fixed landline phone, mobile computing devices, anddesktop computers, wherein the cellular phones, the mobile computingdevices, and the desktop computers are configured with voice overInternet protocol (VOIP).

TECHNICAL EFFECTS

As a result of the summarized invention, a solution is technicallyachieved for a method and system for utilizing intelligent consumerearcons (ICE) that detect the audio surroundings of a user on acommunications device, and based on detected audio information playsearcons of companies and businesses.

BRIEF DESCRIPTION OF THE DRAWINGS

The subject matter that is regarded as the invention is particularlypointed out and distinctly claimed in the claims at the conclusion ofthe specification. The foregoing and other objects, features, andadvantages of the invention are apparent from the following detaileddescription taken in conjunction with the accompanying drawings inwhich:

FIG. 1 illustrates a system for implementing an intelligent earconsystem according to embodiments of the invention.

FIG. 2 is an operational block diagram for implementing intelligentearcon systems according to embodiments of the invention.

FIG. 3 is a detailed operational block diagram for the identification ofthe communication channel (block 218 of FIG. 2) according to embodimentsof the invention.

FIG. 4 is a detailed operational block diagram for sensor processing(block 210 of FIG. 2) and data interpretation (block 214 of FIG. 2)according to embodiments of the invention.

FIG. 5 is a detailed operational block diagram for identification of thecurrent earcon (block 220 of FIG. 2) according to embodiments of theinvention.

FIG. 6 is flow chart for choosing and playing an earcon on acommunication device during the ring cycle according to an embodiment ofthe invention.

FIG. 7 is a flow chart for playing earcons during ring cycle pausesaccording to embodiments of the invention.

The detailed description explains the preferred embodiments of theinvention, together with advantages and features, by way of example withreference to the drawings.

DETAILED DESCRIPTION

Embodiments of the invention provide a method and system for utilizingintelligent consumer earcons (ICE) that detect the audio surroundings ofa user on a communications device, and based on detected audioinformation play earcons related to companies and businesses. In anexemplary application of an embodiment of the invention, when a user isdiscussing a company, product, or service offered by the company ontheir communications device, a speech recognition system detects andinterprets the conversational content, and plays a sound that willremind the user of the company. However, it is important to note thatthe sound played does not interfere in the user's conversation and actsas a quiet advertising reminder. In embodiments of the invention,control of the introduction of earcons to the user's conversation may beaccomplished by creating a user profile (e.g., age, sex, income andpreferences for volume levels and which companies the user wishes toreceive advertisements from. In embodiments of the invention, earconsmay also be created to inform the user of information related to boththeir discussion and the company from which they are receivingadvertisement. For example, if a user is on their communication devicediscussing a new consumer device, the ICE system may play a companyearcon informing the user of a newer consumer device just released, byplaying an earcon the user can identify as “new product available.”

In embodiments of the invention ICE systems are also utilized to assista consumer in locating a store or company location by using the globalpositioning satellite (GPS) system. For example, if a user is on acommunication device discussing a brand of coffee, the coffee brandearcon will play, and then an earcon indicating that the brands coffeeshop is nearby will follow. Embodiments of the invention have earconsthat may be adjusted to the user's preferences. The user can be informedwith a simple “beep” when a store is near, or various different sounds,with different rhythms that may indicate direction and proximity. Theuser's location is tracked using GPS and then correlated with thenearest company or store the user is discussing.

In another embodiment of the invention, the ICE system may be utilizedto search for another person. People often identify their location byusing local stores or companies as landmarks. The ICE system can helppeople find each other and also provide valuable advertisingopportunities. For example, if a person is looking for a friend who saysthey are near a certain store in a busy urban intersection. The ICEsystem recognizes the name of the store and plays the store's earcon,and then a subsequent earcon that indicates the proximity of the neareststore.

FIG. 1 illustrates an exemplary system 100 for implementing anintelligent earcon (ICE) system 120 according to embodiments of theinvention. The system 100 includes mobile communication devices (102,106), fixed landline phones 124, and desktop computer devices 126configured with voice over Internet protocol (VOIP). The mobilecommunication devices (102, 104) are wirelessly connected to a network110. The network 110 may be any type of known network including a fixedwire line network, local area network (LAN), wide area network (WAN),global network (e.g., Internet), intranet, etc. with data/Internetcapabilities as represented by server 122. Communication aspects of thenetwork are represented by cellular base station 112 and antenna 114.

User profiles and databases (blocks 104, 108) for requesting andcontrolling earcon content may be resident on the individualcommunication devices (102, 104, 124, 126) or stored within the server122 or cellular base station 112. The software for running theintelligent earcon system (block 120), and a database of availableearcons (block 118) may be resident on the server 122 or cellular basestation 112.

Location information for implementing positional aspects of theintelligent earcon system may be obtained via global positioning system(GPS) satellites 116 and related electronic device chip sets within themobile communication devices (102, 104), or via terrestrialinfrastructure such as the cellular phone system (112, 114), or Internetgateways. Methods such as triangulating an RF transmission between cellsites (112,114) have proven effective in locating a transmitting device.In a wireless local area network (WLAN), the Internet gateway and theassociated Internet protocol (IP) address may be used to locate themobile communication devices (102, 104).

An example of utilizing the exemplary system 100 for implementing anintelligent earcon system is as follows. A first subscribing user placesa call with their mobile communication device 102 to a secondsubscribing user with mobile communications device 106. Both of thesubscribing users have their own user profile and database (blocks 104,108), which contain information on the user's preferences for earconsand basic information on the user. The first subscribing user(represented by mobile communications device 102) may only wish toreceive earcons from a specified service provider, and wishes to beinformed of new products and store locations regularly. The secondsubscribing user (represented by mobile communications device 106) mayonly wish to receive earcons from a specified coffee provider and wishesto be informed of store locations and exact directions by earcon whenprompted through speech recognition. The ICE system 120 is linked toboth users (102, 106), and actively monitors their conversation in orderto include appropriate earcons from the earcon database 118, based onthe individual user profiles (104, 108). The users (102, 106) aretracked using GPS 116 to facilitate the ICE system 120 in informing theuser of store locations with the appropriate earcon.

FIG. 2 is an operational block diagram for implementing intelligentearcon system according to embodiments of the invention. Audio/video(A/V) data and positional data (e.g., GPS, RF triangulation, IPidentification) (block 200), user profile and preferences (block 204),and other sensor data (e.g., microphone, camera, user biometrics) (block206) are supplied to a sensor data processor (block 210) for processingof the raw data. During data interpretation (block 214), positional datais correlated with information obtained from the audio and/or visualdata. For example, a user says, “I want to drink coffee.” The datainterpretation system uses audio/GPS correlation to identify a locationto buy coffee.

The database of earcons (block 202) contains information about thevarious earcons within the earcon system, and tracks which earconcorresponds to which company and their products and services. Theservice agreement database (block 208) contains information about whichcompany allows the use of their earcons. The service agreement database(block 208) also contains information about privacy and legalconditions. The identification of earcons (block 212) identifiespertinent earcons based on audio/video (A/V) data and positional data(block 200) and service agreement (block 208) from the database ofearcons (block 202). The appropriate context for presenting the earconis determined by the identifier of context (block 216) based on theinterpretation of the data (block 214). The identification of the earconcommunication channel (block 218) is based on the determined context(block 216). For example, earcons may be communicated via ring-tones.The identifier of the communication channel (block 218) determines whenearcons may be communicated (during natural pauses and silence, or asbackground music). The identification of current earcon (block 220)identifies earcons that fit a given situation by duration, context andby the user profile. Finally, the earcon is played (block 222) for theuser.

FIG. 3 is a detailed operational block diagram for the identification ofthe communication channel (block 218 of FIG. 2) according to embodimentsof the invention. The semantic analyzer of conversation (block 300)interprets the semantic content of each input phrase. One example howthe semantic analyzer (block 300) interprets semantic content is tosyntactically parse words and phrases in each input and associatedsemantic classes. For example, the semantic analyzer (block 300)interprets one word received from a syntax parser as a VERB PHRASE, andthen finds a class of words associated with that given verb. Similarly,the semantic analyzer (block 300) interprets other words that are a NOUNPHRASE or other grammatical PHRASES. A set of associated phrasesprovides semantic representation of the textual phrase.

The semantic analyzer (block 300) defines a general category where thegiven semantic content occurs. For example, if the semantic content isrelating to a question/answer such as: “I love to drink cola?” “We needto stop and buy it”—the situation category can be expressed as“DRINKING.” Similarly any phrases about love, meetings with girlfriends,etc. may be expressed as the situation “SEX.” Phrases about children,wife, husband, mother or father may be expressed as the situation“FAMILY” or the content may be more in-depth, such asFAMILY-MEETING-YEAR-1996 in a given year (e.g., was 1996 a verysignificant year from the perspective of family life). The semanticrepresentation of the phrase is used to define conversational pauses.For example, semantic representations may define that the topic of theconversation is switched. If there is also a prolonged silence then thismeans that this silence coincides with the end of one topic ofconversation and a new topic is not yet started. The semantic analyzer(block 300) is capable of recognizing such phrases as “Please, wait, Iwill find a telephone number”. This creates a natural conversationpause.

In addition, the identification of conversational pauses/silence (block302) may also be accomplished with a tonal and inflection analyzer thatanalyzes speech to detect ends of sentences (punctuation), and assistsin the identification of conversational pauses.

A semantic analyzer of the environment (block 304) employs a situationrecognition module that uses known recognition technologies in allpossible media such as speech recognition, image recognition and patternrecognition. The situation recognition module produces strings of units(labels) that have semantic meaning (like words from speech). Astatistical parser that permits the attachment of syntactic structuresto these strings processes these strings of units. Then, in the processof interpretation, strings of units get semantic meanings that “explain”situations and environment. Examples of environments that the system mayrecognize are:

A person speaks in a car

It is very hot summer

This is a conference call where several people participate

a caller is walking on a noisy street, etc.

Examples of a semantic analyzer of environment (block 304) with asituation recognition module are provided in U.S. Pat. No. 6,792,339entitled “Artificial Passenger with Condition Sensors,” and is alsodescribed in patent application publication U.S. 20050192730 entitled“Driver Safety Manager” which are both hereby incorporated by referenceherein in their entirety. The in-vehicle applications of the semanticanalyzer may be readily extended to other environments.

An identification of environmental impact module (block 306) identifiesthe impact of environment on a user and their conversation. Theidentification of environmental impact is done by a set of rules thatassociate with each situation and environment a set of possibleconsequences of this environment on the user and their conversation. Forexample, if a person is driving, there can be natural pauses because thedriver pays attention to their driving and not because of theirconversation, and therefore the driver should not be distracted withearcons. The preceding example defines a rule to check for driverattention if there is a conversational pause. Driver attention may bedefined as found in U.S. Pat. No. 6,792,339 and patent publication U.S.20050192730A1. If a user is on a noisy street then the rule may eitherrequire the suspension of earcon usage, or require the selection ofearcons that may be comprehended in noisy environments.

The interpretation of user biometrics (block 308) is based on thedetection and definition of user biometrics. Examples of user biometricsinclude: gender of the user; age of the user; accent of the user; nativelanguage of the user; dialect of the user; socioeconomic classificationof the user; educational level of the user; and emotional state of theuser. The user biometrics may be used to choose an appropriate earcon.For example, the educational level of the user may determine the typesof earcons that are targeted for them. The dialect of a user may be usedto present earcons oriented to places where user came from. Detectionand definition of user biometrics is disclosed in U.S. Pat. No.6,665,644 entitled “Conversational Data Mining,” and is incorporated byreference herein in its entirety.

The identification of user attention (block 310) is based on the userbiometrics as described in U.S. Pat. No. 6,792,339 and patentpublication U.S. 20050192730A1.

The identification of a channel and appropriate time period to insertand play an earcon (block 312) is determined from the inputs obtainedfrom the identification of conversational pauses/silence (block 302),the identification of environmental impact module (block 306), and theidentification of user attention (block 310), as well as a set of rules.For example, if a long pause is expected while a teenage user speaksover a mobile communication device, and the teenage user is located neara bookstore, and the teenage user is an avid reader of a specific seriesof books, and there is a new book in that series, an earcon for the newbook may be played. The rules can be provided in a form of statisticalmachine, and have a set of rules for prediction of user behavior andreaction as described in U.S. Pat. No. 4,870,579 entitled “System andMethod of Predicting Subjective Reactions”, incorporated by referenceherein in its entirety. An advanced technique for prediction ofsituations is described in U.S. patent application publication20060190822A1 entitled “Predictive User Modeling in User InterfaceDesign”, incorporated by reference herein in its entirety.

FIG. 4 is a detailed operational block diagram for sensor processing(block 210 of FIG. 2) and data interpretation (block 214 of FIG. 2)according to embodiments of the invention. A data separator and labelingmodule (block 400) labels data, such as GPS data (block 402), voiceaudio data (block 404). There are various techniques available toidentify and separate media, and label Data that is identified viasensors that receive it (e.g., data from microphones is audio, and datafrom cameras is video). Other more sophisticated examples of mediaidentification techniques are described in U.S. Pat. No. 6,246,985entitled “Method and Apparatus for Automatic Segregation and Routing ofSignals of Different Origins by Using Prototypes”, incorporated byreference herein in its entirety. The types of media include: audiorelated to a user (e.g., user voice) (block 404), audio environment data(music, background noise) (block 406), video data (related to the user)(block 408) that shows the user—the type of activity they are engagedin, their facial features (this can be used to define user videobiometrics such as age, sex, etc.), and video data related to theenvironment (block 410). The video data related to the environment(block 410) shows the surrounding of the user, such as a streetlocation, or a car where the user is located.

The synchronization block 412 gathers the data from the data sources(blocks 402, 404, 406, 408, 410), and synchronizes the data using timestamps. A relevance determination module (block 414) determines therelevancy of the synchronized data. For example, the relevancedetermination module (block 414) establishes that video of a car thatpasses a user and a street noise are related—the noise comes from thiscar. The synchronization is required for the semantic processing thatwas described in FIG. 3 and for deriving rules for how and when to doearcons. For example, under noisy conditions earcons will be playedlouder for a user.

FIG. 5 is a detailed operational block diagram for identification of thecurrent earcon (block 220 of FIG. 2) according to embodiments of theinvention. A set of earcons (block 500) is a module that stores a set ofdescriptions of available earcons for participating companies, companyrelated advertisements and other situational information. The set ofearcons (block 500) also stores where such earcons are located and howthey may be received. The situational information about the variousearcons is employed to identify what earcon to use in what situation.Some examples of earcon characteristics are provided in blocks 502, 504,and 506.

Block 502 provides information about earcon time duration. Specifically,short duration earcons that may be played during a few seconds, and longduration earcons that may be played for longer periods of time up toseveral minutes. Block 504 identifies the relevancy of earcons from theset of earcons (block 500) to a current user situation. Examples ofdeterminations of relevancy include: how relevant the earcons are to theavailable channel and time period, how relevant the earcons are to thetopic that the user is discussing, relevancy of earcons to theenvironment where the user is located, the expected length of pauses ina conversation, user attitude, etc. Block 506 checks for privacyrelevance, and verifies that an earcon that is played does not intrudeuser privacy. For example, if the earcon has the potential to beoverheard by other users, the earcon is checked so that it does notdisclosure user intent or user interests. Examples of techniques formanaging privacy information are given in U.S. Pat. No. 7,234,065entitled “System and Method for Managing Data Privacy”, incorporated byreference herein in its entirety. Block 508 is an ultimate selector ofearcons based on information provided by blocks 502, 504, and 506. Theultimate selector (block 508) chooses the earcon that best matches allrestrictions that were identified in blocks 502, 504, and 506. Theultimate selector block 508) uses scores of importance to rank eachfactor provided by blocks 502, 504, and 506, and chooses the availableearcon with highest score.

FIG. 6 is flow chart for choosing and playing an earcon on acommunication device during the ring cycle according to an embodiment ofthe invention. The ring cycle starts with a first user's communicationsdevice request for a ring signal (block 600) on second user'scommunications device to initiate a conversation. If there is availableinformation about first user preferences with regards to earcons(decision block 602 is Yes), and there is an earcon that matches thefirst user preferences (decision block 604 is Yes) the appropriateearcon is played (block 610) for the first user. If there are first userpreferences (decision block 602 is Yes), but there are no earconsmatching the first user preferences (decision block 604 is No), a checkis made for advertisers with agreements for playing earcons that are inplace (decision block 606 is Yes), and a default advertisement is playedduring the ring cycle (block 612) for the first user. If there are nofirst user preferences (decision block 602 is No), and there is anadvertiser agreement (decision block 606 is Yes), a defaultadvertisement is played (block 612) for the first user during the ringcycle. If no advertising agreement is in place (decision block 606 isNo), an agreement between communication service providers andadvertisers needs to be arranged (block 608), and the first user onlyhears a ring signal on their communication device.

FIG. 7 is a flow chart for playing earcons during conversation pausesaccording to embodiments of the invention. During a conversation betweena first user and a second user (block 700), the intelligent earconsystem 120 of FIG. 1 determines if there are pauses (decision block702). If there are pauses in the conversation (decision block 702 isYes), a prediction of the length of the pauses is made (block 704), andif the pauses are deemed long enough (decision block 706 is Yes) anearcon is played (block 708) for the first user. If there are no pausesin the conversation (decision block 702 is No), or the pauses are tooshort (decision block 706 is No) the conversation continues (block 700)without earcons.

The capabilities of the present invention can be implemented insoftware, firmware, hardware or some combination thereof.

As one example, one or more aspects of the present invention can beincluded in an article of manufacture (e.g., one or more computerprogram products) having, for instance, computer usable media. The mediahas embodied therein, for instance, computer readable program code meansfor providing and facilitating the capabilities of the presentinvention. The article of manufacture can be included as a part of acomputer system or sold separately.

Additionally, at least one program storage device readable by a machine,tangibly embodying at least one program of instructions executable bythe machine to perform the capabilities of the present invention can beprovided.

The flow diagrams depicted herein are just examples. There may be manyvariations to these diagrams or the steps (or operations) describedtherein without departing from the spirit of the invention. Forinstance, the steps may be performed in a differing order, or steps maybe added, deleted or modified. All of these variations are considered apart of the claimed invention.

While the preferred embodiments to the invention has been described, itwill be understood that those skilled in the art, both now and in thefuture, may make various improvements and enhancements which fall withinthe scope of the claims which follow. These claims should be construedto maintain the proper protection for the invention first described.

1. A method for utilizing earcons, the method comprising: forming adatabase of earcons; forming a user profile and preferences database;monitoring user audio content; monitoring user environment; playing aseries of earcons from the database of earcons on a user's communicationdevice; wherein the series of earcons are chosen from the database ofearcons based on the user profile and preferences database; and whereinthe playing of individual earcons from the series of earcons is based onthe monitored user audio content and environment.
 2. The method of claim1, wherein the database of earcons is comprised of at least one of thefollowing: company, product, service, retail location, and earcon lengthinformation.
 3. The method of claim 1, wherein the user profile andpreferences database is comprised of user and observationally supplieduser profile information; and wherein the monitoring of the userenvironment provides the observationally supplied user profileinformation.
 4. The method of claim 1, wherein the user profile andpreferences database is comprised of user biometric data; and whereinthe user biometric data comprises one or more of gender of the user, ageof the user, accent of the user, native language of the user, dialect ofthe user, socioeconomic classification of the user, educational level ofthe user, and emotional state of the user.
 5. The method of claim 1,wherein the user profile and preferences database is comprised of userpreferences; wherein the user preferences includes types of companies,products, services the user wants to receive earcons about; and whereinthe user preferences further comprise specified audio levels, lengths,and points in the usage of the communication device and the conversationfor playing the earcons.
 6. The method of claim 1, wherein themonitoring of user audio content comprises using a speech recognitionsystem to detect and interpret conversational content; wherein based onthe interpreted conversational content earcons are chosen for playbackon the user's communications device; wherein the monitoring of useraudio content is used to determine pauses in the user's conversation;wherein based on the determined pauses and their respective length,earcons are chosen for playback on the user's communications device;wherein the monitoring of the user environment comprises tracking thelocation of the user; wherein the tracking of user location comprisesthe use of at least one of the following: global positioning system(GPS) satellites and related electronic device chip sets within thecommunication devices, cellular phone infrastructure, and Internetgateways; wherein based on the user location an earcon is chosen forplayback on the user's communications device; and wherein thecommunication devices comprise one or more of: cellular phones, fixedlandline phone, mobile computing devices, and desktop computers; andwherein the cellular phones, the mobile computing devices, and thedesktop computers are configured with voice over Internet protocol(VOIP).
 7. A method for implementing earcons; the method comprising:gathering data from a series of sources; processing the data;interpreting the processed data; selecting earcons based on theinterpretation of the data from a database of earcons; playing theselected earcons on a user's communication device based on theinterpreted data; wherein series of sources comprise audio/video (A/V)data, positional data, user profiles, user preferences, and other sensordata; and wherein the other sensor data includes data from microphones,cameras, and user biometrics.
 8. The method of claim 7, wherein duringthe interpreting of the processed data, the positional data iscorrelated with the A/V data; wherein the positional data is obtainedwith at least one of the following: global positioning system (GPS)satellites and related electronic device chip sets within thecommunication devices, cellular phone infrastructure, and Internetgateways; wherein the database of earcons is comprised of at least oneof the following: company, product, service, retail location, and earconlength information; wherein database of earcons tracks which earconcorresponds to which company and their products and services; whereinthe selection of an earcon is dependent on a service agreement database;wherein the service agreement database contains information about whichcompany allows the use of their earcons; wherein the service agreementdatabase also contains information about privacy and legal conditions;wherein the biometric data comprises one or more of gender of the user,age of the user, accent of the user, native language of the user,dialect of the user, socioeconomic classification of the user,educational level of the user, and emotional state of the user; whereinthe user preferences includes types of companies, products, services theuser wants to receive earcons about; wherein the user preferencesfurther comprise specified audio levels, lengths, and points in theusage of the communication device and the conversation for playing theearcons; wherein the interpreting of the processed data includessemantic analysis with a semantic analyzer to determine pauses andbreaks in the users conversation for playing of earcons; wherein thelength of the pauses and breaks determines which earcon to play; whereinspeech recognition is employed during processing and interpreting theaudio data to determine how relevant the earcons are to the topic thatthe user is discussing; wherein the choice of earcon to play is based ona ranking of factors; and wherein the factors comprise relevancy of theearcon to the user.